Cortical lesions uniquely predict motor disability accrual and form rarely in the absence of new white matter lesions in multiple sclerosis.

Background and objectives: Cortical lesions (CL) are common in multiple sclerosis (MS) and associate with disability and progressive disease. We asked whether CL continue to form in people with stable white matter lesions (WML) and whether the association of CL with worsening disability relates to pre-existing or new CL. Methods: A cohort of adults with MS were evaluated annually with 7 tesla (T) brain magnetic resonance imaging (MRI) and 3T brain and spine MRI for 2 years, and clinical assessments for 3 years. CL were identified on 7T images at each timepoint. WML and brain tissue segmentation were performed using 3T images at baseline and year 2. Results: 59 adults with MS had ≥1 7T follow-up visit (mean follow-up time 2±0.5 years). 9 had "active" relapsing-remitting MS (RRMS), defined as new WML in the year prior to enrollment. Of the remaining 50, 33 had "stable" RRMS, 14 secondary progressive MS (SPMS), and 3 primary progressive MS. 16 total new CL formed in the active RRMS group (median 1, range 0-10), 7 in the stable RRMS group (median 0, range 0-5), and 4 in the progressive MS group (median 0, range 0-1) (p=0.006, stable RR vs PMS p=0.88). New CL were not associated with greater change in any individual disability measure or in a composite measure of disability worsening (worsening Expanded Disability Status Scale or 9-hole peg test or 25-foot timed walk). Baseline CL volume was higher in people with worsening disability (median 1010µl, range 13-9888 vs median 267µl, range 0-3539, p=0.001, adjusted for age and sex) and in individuals with RRMS who subsequently transitioned to SPMS (median 2183µl, range 270-9888 vs median 321µl, range 0-6392 in those who remained RRMS, p=0.01, adjusted for age and sex). Baseline WML volume was not associated with worsening disability or transition from RRMS to SPMS. Discussion: CL formation is rare in people with stable WML, even in those with worsening disability. CL but not WML burden predicts future worsening of disability, suggesting that the relationship between CL and disability progression is related to long-term effects of lesions that form in the earlier stages of disease, rather than to ongoing lesion formation.

T1 /T2 ratio from 3T MRI improves multiple sclerosis cortical lesion contrast.

BACKGROUND AND PURPOSE: Cortical demyelinated lesions are prevalent in multiple sclerosis (MS), associated with disability, and have recently been incorporated into MS diagnostic criteria. Presently, advanced and ultrahigh-field MRIs-not routinely available in clinical practice-are the most sensitive methods for detection of cortical lesions. Approaches utilizing MRI sequences obtainable in routine clinical practice remain an unmet need. We plan to assess the sensitivity of the ratio of T1 -weighted and T2 -weighted (T1 /T2 ) signal intensity for focal cortical lesions in comparison to other high-field imaging methods. METHODS: 3-Tesla and 7-Tesla MRI collected from 10 adults with MS were included in the study. T1 /T2 images were calculated by dividing 3T T1 -weighted (T1 w) images by 3T T2 -weighted (T2 w) fluid-attenuated inversion recovery images for each participant. A total of 614 cortical lesions were identified using 7T T2 *w and T1 w images and corresponding voxels were assessed on registered 3T images. Signal intensities were compared across 3T imaging sequences, including T1 /T2 , T1 w, T2 w, and inversion recovery susceptibility-weighted imaging with enhanced T2 weighting (IR-SWIET) images. RESULTS: T1 /T2 images demonstrated a larger contrast between median lesional and nonlesional cortical signal intensity (median ratio = 1.29, range: 1.19-1.38) when compared to T1 w (1.01, 0.97-1.10, p < .002), T2 w (1.17, 1.07-1.26, p < .002), and IR-SWIET (1.21, 1.01-1.29, p < .03). CONCLUSION: T1 /T2 images are sensitive to cortical lesions. Approaches incorporating T1 /T2 could improve the accessibility of cortical lesion detection in research settings and clinical practice.

Logistic Regression-Based Model Is More Efficient Than U-Net Model for Reliable Whole Brain Magnetic Resonance Imaging Segmentation.

OBJECTIVES: Automated whole brain segmentation from magnetic resonance images is of great interest for the development of clinically relevant volumetric markers for various neurological diseases. Although deep learning methods have demonstrated remarkable potential in this area, they may perform poorly in nonoptimal conditions, such as limited training data availability. Manual whole brain segmentation is an incredibly tedious process, so minimizing the data set size required for training segmentation algorithms may be of wide interest. The purpose of this study was to compare the performance of the prototypical deep learning segmentation architecture (U-Net) with a previously published atlas-free traditional machine learning method, Classification using Derivative-based Features (C-DEF) for whole brain segmentation, in the setting of limited training data. MATERIALS AND METHODS: C-DEF and U-Net models were evaluated after training on manually curated data from 5, 10, and 15 participants in 2 research cohorts: (1) people living with clinically diagnosed HIV infection and (2) relapsing-remitting multiple sclerosis, each acquired at separate institutions, and between 5 and 295 participants' data using a large, publicly available, and annotated data set of glioblastoma and lower grade glioma (brain tumor segmentation). Statistics was performed on the Dice similarity coefficient using repeated-measures analysis of variance and Dunnett-Hsu pairwise comparison. RESULTS: C-DEF produced better segmentation than U-Net in lesion (29.2%-38.9%) and cerebrospinal fluid (5.3%-11.9%) classes when trained with data from 15 or fewer participants. Unlike C-DEF, U-Net showed significant improvement when increasing the size of the training data (24%-30% higher than baseline). In the brain tumor segmentation data set, C-DEF produced equivalent or better segmentations than U-Net for enhancing tumor and peritumoral edema regions across all training data sizes explored. However, U-Net was more effective than C-DEF for segmentation of necrotic/non-enhancing tumor when trained on 10 or more participants, probably because of the inconsistent signal intensity of the tissue class. CONCLUSIONS: These results demonstrate that classical machine learning methods can produce more accurate brain segmentation than the far more complex deep learning methods when only small or moderate amounts of training data are available (n ≤ 15). The magnitude of this advantage varies by tissue and cohort, while U-Net may be preferable for deep gray matter and necrotic/non-enhancing tumor segmentation, particularly with larger training data sets (n ≥ 20). Given that segmentation models often need to be retrained for application to novel imaging protocols or pathology, the bottleneck associated with large-scale manual annotation could be avoided with classical machine learning algorithms, such as C-DEF.

Cortical lesion hotspots and association of subpial lesions with disability in multiple sclerosis.

BACKGROUND: Dramatic improvements in visualization of cortical (especially subpial) multiple sclerosis (MS) lesions allow assessment of impact on clinical course. OBJECTIVE: Characterize cortical lesions by 7 tesla (T) T2*-/T1-weighted magnetic resonance imaging (MRI); determine relationship with other MS pathology and contribution to disability. METHODS: Sixty-four adults with MS (45 relapsing-remitting/19 progressive) underwent 3 T brain/spine MRI, 7 T brain MRI, and clinical testing. RESULTS: Cortical lesions were found in 94% (progressive: median 56/range 2-203; relapsing-remitting: 15/0-168; p = 0.004). Lesion distribution across 50 cortical regions was nonuniform (p = 0.006), with highest lesion burden in supplementary motor cortex and highest prevalence in superior frontal gyrus. Leukocortical and white matter lesion volumes were strongly correlated (r = 0.58, p < 0.0001), while subpial and white matter lesion volumes were moderately correlated (r = 0.30, p = 0.002). Leukocortical (p = 0.02) but not subpial lesions (p = 0.40) were correlated with paramagnetic rim lesions; both were correlated with spinal cord lesions (p = 0.01). Cortical lesion volumes (total and subtypes) were correlated with expanded disability status scale, 25-foot timed walk, nine-hole peg test, and symbol digit modality test scores. CONCLUSION: Cortical lesions are highly prevalent and are associated with disability and progressive disease. Subpial lesion burden is not strongly correlated with white matter lesions, suggesting differences in inflammation and repair mechanisms.

On the generalizability of diffusion MRI signal representations across acquisition parameters, sequences and tissue types: Chronicles of the MEMENTO challenge.

Diffusion MRI (dMRI) has become an invaluable tool to assess the microstructural organization of brain tissue. Depending on the specific acquisition settings, the dMRI signal encodes specific properties of the underlying diffusion process. In the last two decades, several signal representations have been proposed to fit the dMRI signal and decode such properties. Most methods, however, are tested and developed on a limited amount of data, and their applicability to other acquisition schemes remains unknown. With this work, we aimed to shed light on the generalizability of existing dMRI signal representations to different diffusion encoding parameters and brain tissue types. To this end, we organized a community challenge - named MEMENTO, making available the same datasets for fair comparisons across algorithms and techniques. We considered two state-of-the-art diffusion datasets, including single-diffusion-encoding (SDE) spin-echo data from a human brain with over 3820 unique diffusion weightings (the MASSIVE dataset), and double (oscillating) diffusion encoding data (DDE/DODE) of a mouse brain including over 2520 unique data points. A subset of the data sampled in 5 different voxels was openly distributed, and the challenge participants were asked to predict the remaining part of the data. After one year, eight participant teams submitted a total of 80 signal fits. For each submission, we evaluated the mean squared error, the variance of the prediction error and the Bayesian information criteria. The received submissions predicted either multi-shell SDE data (37%) or DODE data (22%), followed by cartesian SDE data (19%) and DDE (18%). Most submissions predicted the signals measured with SDE remarkably well, with the exception of low and very strong diffusion weightings. The prediction of DDE and DODE data seemed more challenging, likely because none of the submissions explicitly accounted for diffusion time and frequency. Next to the choice of the model, decisions on fit procedure and hyperparameters play a major role in the prediction performance, highlighting the importance of optimizing and reporting such choices. This work is a community effort to highlight strength and limitations of the field at representing dMRI acquired with trending encoding schemes, gaining insights into how different models generalize to different tissue types and fiber configurations over a large range of diffusion encodings.

AUTOMATIC LABELING OF CORTICAL SULCI USING SPHERICAL CONVOLUTIONAL NEURAL NETWORKS IN A DEVELOPMENTAL COHORT.

In this paper, we present the automatic labeling framework for sulci in the human lateral prefrontal cortex (PFC). We adapt an existing spherical U-Net architecture with our recent surface data augmentation technique to improve the sulcal labeling accuracy in a developmental cohort. Specifically, our framework consists of the following key components: (1) augmented geometrical features being generated during cortical surface registration, (2) spherical U-Net architecture to efficiently fit the augmented features, and (3) postrefinement of sulcal labeling by optimizing spatial coherence via a graph cut technique. We validate our method on 30 healthy subjects with manual labeling of sulcal regions within PFC. In the experiments, we demonstrate significantly improved labeling performance (0.7749) in mean Dice overlap compared to that of multi-atlas (0.6410) and standard spherical U-Net (0.7011) approaches, respectively (p < 0.05). Additionally, the proposed method achieves a full set of sulcal labels in 20 seconds in this developmental cohort.

Tractography reproducibility challenge with empirical data (TraCED): The 2017 ISMRM diffusion study group challenge.

BACKGROUND: Fiber tracking with diffusion-weighted MRI has become an essential tool for estimating in vivo brain white matter architecture. Fiber tracking results are sensitive to the choice of processing method and tracking criteria. PURPOSE: To assess the variability for an algorithm in group studies reproducibility is of critical context. However, reproducibility does not assess the validity of the brain connections. Phantom studies provide concrete quantitative comparisons of methods relative to absolute ground truths, yet do no capture variabilities because of in vivo physiological factors. The ISMRM 2017 TraCED challenge was created to fulfill the gap. STUDY TYPE: A systematic review of algorithms and tract reproducibility studies. SUBJECTS: Single healthy volunteers. FIELD STRENGTH/SEQUENCE: 3.0T, two different scanners by the same manufacturer. The multishell acquisition included b-values of 1000, 2000, and 3000 s/mm2 with 20, 45, and 64 diffusion gradient directions per shell, respectively. ASSESSMENT: Nine international groups submitted 46 tractography algorithm entries each consisting 16 tracts per scan. The algorithms were assessed using intraclass correlation (ICC) and the Dice similarity measure. STATISTICAL TESTS: Containment analysis was performed to assess if the submitted algorithms had containment within tracts of larger volume submissions. This also serves the purpose to detect if spurious submissions had been made. RESULTS: The top five submissions had high ICC and Dice >0.88. Reproducibility was high within the top five submissions when assessed across sessions or across scanners: 0.87-0.97. Containment analysis shows that the top five submissions are contained within larger volume submissions. From the total of 16 tracts as an outcome relatively the number of tracts with high, moderate, and low reproducibility were 8, 4, and 4. DATA CONCLUSION: The different methods clearly result in fundamentally different tract structures at the more conservative specificity choices. Data and challenge infrastructure remain available for continued analysis and provide a platform for comparison. LEVEL OF EVIDENCE: 5 Technical Efficacy Stage: 1 J. Magn. Reson. Imaging 2020;51:234-249.

Progressive multifocal leukoencephalopathy lesion and brain parenchymal segmentation from MRI using serial deep convolutional neural networks.

Progressive multifocal leukoencephalopathy (PML) is a rare opportunistic brain infection caused by the JC virus and associated with substantial morbidity and mortality. Accurate MRI assessment of PML lesion burden and brain parenchymal atrophy is of decisive value in monitoring the disease course and response to therapy. However, there are currently no validated automatic methods for quantification of PML lesion burden or associated parenchymal volume loss. Furthermore, manual brain or lesion delineations can be tedious, require the use of valuable time resources by radiologists or trained experts, and are often subjective. In this work, we introduce JCnet (named after the causative viral agent), an end-to-end, fully automated method for brain parenchymal and lesion segmentation in PML using consecutive 3D patch-based convolutional neural networks. The network architecture consists of multi-view feature pyramid networks with hierarchical residual learning blocks containing embedded batch normalization and nonlinear activation functions. The feature maps across the bottom-up and top-down pathways of the feature pyramids are merged, and an output probability membership generated through convolutional pathways, thus rendering the method fully convolutional. Our results show that this approach outperforms and improves longitudinal consistency compared to conventional, state-of-the-art methods of healthy brain and multiple sclerosis lesion segmentation, utilized here as comparators given the lack of available methods validated for use in PML. The ability to produce robust and accurate automated measures of brain atrophy and lesion segmentation in PML is not only valuable clinically but holds promise toward including standardized quantitative MRI measures in clinical trials of targeted therapies. Code is available at: https://github.com/omarallouz/JCnet.

Cortical Surface Parcellation using Spherical Convolutional Neural Networks.

We present cortical surface parcellation using spherical deep convolutional neural networks. Traditional multi-atlas cortical surface parcellation requires inter-subject surface registration using geometric features with slow processing speed on a single subject (2-3 hours). Moreover, even optimal surface registration does not necessarily produce optimal cortical parcellation as parcel boundaries are not fully matched to the geometric features. In this context, a choice of training features is important for accurate cortical parcellation. To utilize the networks efficiently, we propose cortical parcellation-specific input data from an irregular and complicated structure of cortical surfaces. To this end, we align ground-truth cortical parcel boundaries and use their resulting deformation fields to generate new pairs of deformed geometric features and parcellation maps. To extend the capability of the networks, we then smoothly morph cortical geometric features and parcellation maps using the intermediate deformation fields. We validate our method on 427 adult brains for 49 labels. The experimental results show that our method outperforms traditional multi-atlas and naive spherical U-Net approaches, while achieving full cortical parcellation in less than a minute.

Coronary Calcium Detection using 3D Attention Identical Dual Deep Network Based on Weakly Supervised Learning.

Coronary artery calcium (CAC) is biomarker of advanced subclinical coronary artery disease and predicts myocardial infarction and death prior to age 60 years. The slice-wise manual delineation has been regarded as the gold standard of coronary calcium detection. However, manual efforts are time and resource consuming and even impracticable to be applied on large-scale cohorts. In this paper, we propose the attention identical dual network (AID-Net) to perform CAC detection using scan-rescan longitudinal non-contrast CT scans with weakly supervised attention by only using per scan level labels. To leverage the performance, 3D attention mechanisms were integrated into the AID-Net to provide complementary information for classification tasks. Moreover, the 3D Gradient-weighted Class Activation Mapping (Grad-CAM) was also proposed at the testing stage to interpret the behaviors of the deep neural network. 5075 non-contrast chest CT scans were used as training, validation and testing datasets. Baseline performance was assessed on the same cohort. From the results, the proposed AID-Net achieved the superior performance on classification accuracy (0.9272) and AUC (0.9627).

Consideration of Cerebrospinal Fluid Intensity Variation in Diffusion Weighted MRI.

Diffusion weighted MRI (DW-MRI) depends on accurate quantification signal intensities that reflect directional apparent diffusion coefficients (ADC). Signal drift and fluctuations during imaging can cause systematic non-linearities that manifest as ADC changes if not corrected. Here, we present a case study on a large longitudinal dataset of typical diffusion tensor imaging. We investigate observed variation in the cerebral spinal fluid (CSF) regions of the brain, which should represent compartments with isotropic diffusivity. The study contains 3949 DW-MRI acquisitions of the human brain with 918 subjects and 542 with repeated scan sessions. We provide an analysis of the inter-scan, inter-session, and intra-session variation and an analysis of the associations with the applied diffusion gradient directions. We investigate a hypothesis that CSF models could be used in lieu of an interspersed minimally diffusion-weighted image (b0) correction. Variation in CSF signal is not largely attributable to within-scan dynamic anatomical changes (3.6%), but rather has substantial variation across scan sessions (10.6%) and increased variation across individuals (26.6%). Unfortunately, CSF intensity is not solely explained by a main drift model or a gradient model, but rather has statistically significant associations with both possible explanations. Further exploration is necessary for CSF drift to be used as an effective harmonization technique.

Deep learning reveals untapped information for local white-matter fiber reconstruction in diffusion-weighted MRI.

PURPOSE: Diffusion-weighted magnetic resonance imaging (DW-MRI) is of critical importance for characterizing in-vivo white matter. Models relating microarchitecture to observed DW-MRI signals as a function of diffusion sensitization are the lens through which DW-MRI data are interpreted. Numerous modern approaches offer opportunities to assess more complex intra-voxel structures. Nevertheless, there remains a substantial gap between intra-voxel estimated structures and ground truth captured by 3-D histology. METHODS: Herein, we propose a novel data-driven approach to model the non-linear mapping between observed DW-MRI signals and ground truth structures using a sequential deep neural network regression using residual block deep neural network (ResDNN). Training was performed on two 3-D histology datasets of squirrel monkey brains and validated on a third. A second validation was performed using scan-rescan datasets of 12 subjects from Human Connectome Project. The ResDNN was compared with multiple micro-structure reconstruction methods and super resolved-constrained spherical deconvolution (sCSD) in particular as baseline for both the validations. RESULTS: Angular correlation coefficient (ACC) is a correlation/similarity measure and can be interpreted as accuracy when compared with a ground truth. The median ACC of ResDNN is 0.82 and median ACC's of different variants of CSD are 0.75, 0.77, 0.79. The mean, median and std. of ResDNN & sCSD ACC across 12 subjects from HCP are 0.74, 0.88, 0.31 and 0.61, 0.71, 0.31 respectively. CONCLUSION: This work highlights the ability of deep learning to capture linkages between ex-vivo ground truth data with feasible MRI sequences. The data-driven approach is applicable to human in-vivo data and results in intriguingly high reproducibility of orientation structure.

Improving human cortical sulcal curve labeling in large scale cross-sectional MRI using deep neural networks.

BACKGROUND: Human cortical primary sulci are relatively stable landmarks and commonly observed across the population. Despite their stability, the primary sulci exhibit phenotypic variability. NEW METHOD: We propose a fully automated pipeline that integrates both sulcal curve extraction and labeling. In this study, we use a large normal control population (n = 1424) to train neural networks for accurately labeling the primary sulci. Briefly, we use sulcal curve distance map, surface parcellation, mean curvature and spectral features to delineate their sulcal labels. We evaluate the proposed method with 8 primary sulcal curves in the left and right hemispheres compared to an established multi-atlas curve labeling method. RESULTS: Sulcal labels by the proposed method reasonably well agree with manual labeling. The proposed method outperforms the existing multi-atlas curve labeling method. COMPARISON WITH EXISTING METHOD: Significantly improved sulcal labeling results are achieved with over 12.5 and 20.6 percent improvement on labeling accuracy in the left and right hemispheres, respectively compared to that of a multi-atlas curve labeling method in eight curves (p≪0.001, two-sample t-test). CONCLUSION: The proposed method offers a computationally efficient and robust labeling of major sulci.

Improved gray matter surface based spatial statistics in neuroimaging studies.

Neuroimaging often involves acquiring high-resolution anatomical images along with other low-resolution image modalities, like diffusion and functional magnetic resonance imaging. Performing gray matter statistics with low-resolution image modalities is a challenge due to registration artifacts and partial volume effects. Gray matter surface based spatial statistics (GS-BSS) has been shown to provide higher sensitivity using gray matter surfaces compared to that of skeletonization approach of gray matter based spatial statistics which is adapted from tract based spatial statistics in diffusion studies. In this study, we improve upon GS-BSS incorporating neurite orientation dispersion and density imaging (NODDI) based search (denoted N-GSBSS) by 1) enhancing metrics mapping from native space, 2) incorporating maximum orientation dispersion index (ODI) search along surface normal, and 3) proposing applicability to other modalities, such as functional MRI (fMRI). We evaluated the performance of N-GSBSS against three baseline pipelines: volume-based registration, FreeSurfer's surface registration and ciftify pipeline for fMRI and simulation studies. First, qualitative mean ODI results are shown for N-GSBSS with and without NODDI based search in comparison with ciftify pipeline. Second, we conducted one-sample t-tests on working memory activations in fMRI to show that the proposed method can aid in the analysis of low resolution fMRI data. Finally we performed a sensitivity test in a simulation study by varying percentage change of intensity values within a region of interest in gray matter probability maps. N-GSBSS showed higher sensitivity in the simulation test compared to the other methods capturing difference between the groups starting at 10% change in the intensity values. The computational time of N-GSBSS is 68 times faster than that of traditional surface-based or 86 times faster than that of ciftify pipeline analysis.

Registration-based image enhancement improves multi-atlas segmentation of the thalamic nuclei and hippocampal subfields.

Magnetic resonance imaging (MRI) is an important tool for analysis of deep brain grey matter structures. However, analysis of these structures is limited due to low intensity contrast typically found in whole brain imaging protocols. Herein, we propose a big data registration-enhancement (BDRE) technique to augment the contrast of deep brain structures using an efficient large-scale non-rigid registration strategy. Direct validation is problematic given a lack of ground truth data. Rather, we validate the usefulness and impact of BDRE for multi-atlas (MA) segmentation on two sets of structures of clinical interest: the thalamic nuclei and hippocampal subfields. The experimental design compares algorithms using T1-weighted 3 T MRI for both structures (and additional 7 T MRI for the thalamic nuclei) with an algorithm using BDRE. As baseline comparisons, a recent denoising (DN) technique and a super-resolution (SR) method are used to preprocess the original 3 T MRI. The performance of each MA segmentation is evaluated by the Dice similarity coefficient (DSC). BDRE significantly improves mean segmentation accuracy over all methods tested for both thalamic nuclei (3 T imaging: 9.1%; 7 T imaging: 15.6%; DN: 6.9%; SR: 16.2%) and hippocampal subfields (3 T T1 only: 8.7%; DN: 8.4%; SR: 8.6%). We also present DSC performance for each thalamic nucleus and hippocampal subfield and show that BDRE can help MA segmentation for individual thalamic nuclei and hippocampal subfields. This work will enable large-scale analysis of clinically relevant deep brain structures from commonly acquired T1 images.

A deep learning approach to estimation of subject-level bias and variance in high angular resolution diffusion imaging.

The ability to evaluate empirical diffusion MRI acquisitions for quality and to correct the resulting imaging metrics allows for improved inference and increased replicability. Previous work has shown promise for estimation of bias and variance of generalized fractional anisotropy (GFA) but comes at the price of computational complexity. This paper aims to provide methods for estimating GFA, bias of GFA and standard deviation of GFA quickly and accurately. In order to provide a method for bias and variance estimation that can return results faster than the previously studied statistical techniques, three deep, fully-connected neural networks are developed for GFA, bias of GFA, and standard deviation of GFA. The results of these networks are compared to the observed values of the metrics as well as those fit from the statistical techniques (i.e. Simulation Extrapolation (SIMEX) for bias estimation and wild bootstrap for variance estimation). Our GFA network provides predictions that are closer to the true GFA values than a Q-ball fit of the observed data (root-mean-square error (RMSE) 0.0077 vs 0.0082, p < .001). The bias network also shows statistically significant improvement in comparison to the SIMEX-estimated error of GFA (RMSE 0.0071 vs. 0.01, p < .001).

3D whole brain segmentation using spatially localized atlas network tiles.

Detailed whole brain segmentation is an essential quantitative technique in medical image analysis, which provides a non-invasive way of measuring brain regions from a clinical acquired structural magnetic resonance imaging (MRI). Recently, deep convolution neural network (CNN) has been applied to whole brain segmentation. However, restricted by current GPU memory, 2D based methods, downsampling based 3D CNN methods, and patch-based high-resolution 3D CNN methods have been the de facto standard solutions. 3D patch-based high resolution methods typically yield superior performance among CNN approaches on detailed whole brain segmentation (>100 labels), however, whose performance are still commonly inferior compared with state-of-the-art multi-atlas segmentation methods (MAS) due to the following challenges: (1) a single network is typically used to learn both spatial and contextual information for the patches, (2) limited manually traced whole brain volumes are available (typically less than 50) for training a network. In this work, we propose the spatially localized atlas network tiles (SLANT) method to distribute multiple independent 3D fully convolutional networks (FCN) for high-resolution whole brain segmentation. To address the first challenge, multiple spatially distributed networks were used in the SLANT method, in which each network learned contextual information for a fixed spatial location. To address the second challenge, auxiliary labels on 5111 initially unlabeled scans were created by multi-atlas segmentation for training. Since the method integrated multiple traditional medical image processing methods with deep learning, we developed a containerized pipeline to deploy the end-to-end solution. From the results, the proposed method achieved superior performance compared with multi-atlas segmentation methods, while reducing the computational time from >30 h to 15 min. The method has been made available in open source (https://github.com/MASILab/SLANTbrainSeg).

Harmonizing 1.5T/3T Diffusion Weighted MRI through Development of Deep Learning Stabilized Microarchitecture Estimators.

Diffusion weighted magnetic resonance imaging (DW-MRI) is interpreted as a quantitative method that is sensitive to tissue microarchitecture at a millimeter scale. However, the sensitization is dependent on acquisition sequences (e.g., diffusion time, gradient strength, etc.) and susceptible to imaging artifacts. Hence, comparison of quantitative DW-MRI biomarkers across field strengths (including different scanners, hardware performance, and sequence design considerations) is a challenging area of research. We propose a novel method to estimate microstructure using DW-MRI that is robust to scanner difference between 1.5T and 3T imaging. We propose to use a null space deep network (NSDN) architecture to model DW-MRI signal as fiber orientation distributions (FOD) to represent tissue microstructure. The NSDN approach is consistent with histologically observed microstructure (on previously acquired ex vivo squirrel monkey dataset) and scan-rescan data. The contribution of this work is that we incorporate identical dual networks (IDN) to minimize the influence of scanner effects via scan-rescan data. Briefly, our estimator is trained on two datasets. First, a histology dataset was acquired on three squirrel monkeys with corresponding DW-MRI and confocal histology (512 independent voxels). Second, 37 control subjects from the Baltimore Longitudinal Study of Aging (67-95 y/o) were identified who had been scanned at 1.5T and 3T scanners (b-value of 700 s/mm2, voxel resolution at 2.2mm, 30-32 gradient volumes) with an average interval of 4 years (standard deviation 1.3 years). After image registration, we used paired white matter (WM) voxels for 17 subjects and 440 histology voxels for training and 20 subjects and 72 histology voxels for testing. We compare the proposed estimator with super-resolved constrained spherical deconvolution (CSD) and a previously presented regression deep neural network (DNN). NSDN outperformed CSD and DNN in angular correlation coefficient (ACC) 0.81 versus 0.28 and 0.46, mean squared error (MSE) 0.001 versus 0.003 and 0.03, and general fractional anisotropy (GFA) 0.05 versus 0.05 and 0.09. Further validation and evaluation with contemporaneous imaging are necessary, but the NSDN is promising avenue for building understanding of microarchitecture in a consistent and device-independent manner.

Characterization and correlation of signal drift in diffusion weighted MRI.

Diffusion weighted MRI (DWMRI) and the myriad of analysis approaches (from tensors to spherical harmonics and brain tractography to body multi-compartment models) depend on accurate quantification of the apparent diffusion coefficient (ADC). Signal drift during imaging (e.g., due to b0 drift associated with heating) can cause systematic non-linearities that manifest as ADC changes if not corrected. Herein, we present a case study on two phantoms on one scanner. Different scan protocols exhibit different degrees of drift during similar scans and may be sensitive to the order of scans within an exam. Vos et al. recently reviewed the effects of signal drift in DWMRI acquisitions and proposed a temporal model for correction. We propose a novel spatial-temporal model to correct for higher order aspects of the signal drift and derive a statistically robust variant. We evaluate the Vos model and propose a method using two phantoms that mimic the ADC of the relevant brain tissue (0.36-2.2 × 10-3 mm2/s) on a single 3 T scanner. The phantoms are (1) a spherical isotropic sphere consisting of a single concentration of polyvinylpyrrolidone (PVP) and (2) an ice-water phantom with 13 vials of varying PVP concentrations. To characterize the impact of interspersed minimally weighted volumes ("b0's"), image volumes with b-value equal to 0.1 s/mm2 are interspersed every 8, 16, 32, 48, and 96 diffusion weighted volumes in different trials. Signal drift is found to have spatially varying effects that are not accounted for with temporal-only models. The novel model captures drift more accurately (i.e., reduces the overall change per-voxel over the course of a scan) and results in more consistent ADC metrics.

Limits to anatomical accuracy of diffusion tractography using modern approaches.

Diffusion MRI fiber tractography is widely used to probe the structural connectivity of the brain, with a range of applications in both clinical and basic neuroscience. Despite widespread use, tractography has well-known pitfalls that limits the anatomical accuracy of this technique. Numerous modern methods have been developed to address these shortcomings through advances in acquisition, modeling, and computation. To test whether these advances improve tractography accuracy, we organized the 3-D Validation of Tractography with Experimental MRI (3D-VoTEM) challenge at the ISBI 2018 conference. We made available three unique independent tractography validation datasets - a physical phantom and two ex vivo brain specimens - resulting in 176 distinct submissions from 9 research groups. By comparing results over a wide range of fiber complexities and algorithmic strategies, this challenge provides a more comprehensive assessment of tractography's inherent limitations than has been reported previously. The central results were consistent across all sub-challenges in that, despite advances in tractography methods, the anatomical accuracy of tractography has not dramatically improved in recent years. Taken together, our results independently confirm findings from decades of tractography validation studies, demonstrate inherent limitations in reconstructing white matter pathways using diffusion MRI data alone, and highlight the need for alternative or combinatorial strategies to accurately map the fiber pathways of the brain.